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METHOD AND SYSTEM FOR MANAGING ABNORMAL DISCONNECTS 
DURING A STREAMING MEDIA SESSION 

BACKGROUND 

5 I* Field of the Invention 

The present invention is directed to multimedia streaming. More particularly, the 
present invention is directed to methods and systems for managing abnormal disconnects 
during a streaming media session. 

10 II. Description of Related Art 

Wireless communication systems are experiencing rapid advances in the services, 
products and features that are available to consumers using such conununication systems. 
In this regard, cellular/mobile phones have evolved into mobile devices that provide a 
rich feature set to consumers, such as hitemet access, data network access, the ability to 

15 take and send pictures and video, text messaging capabilities, and the abihty to playback 
multimedia content (e.g., music, video), among numerous other features. In fact, such 
mobile devices may, or may not, include mobile telephone capabilities. 

Playing multimedia content on such mobile devices is quickly becoming more 
and more common. Such playback may be accomplished in various manners. One 

20 approach to playing back multimedia content (which may be termed "multimedia clips" 
or "clips") is to download a clip from a content server (e.g., a computing device, which 
contains one or more clips) to the mobile device, such as using hypertext transfer 
protocol (http) based data communication. Once the clip is downloaded to the device, it 
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is then typically played using a media player client installed on the mobile device. For 
small media clips this may be readily easy to accomplish. 

However, for large clips (such as, for example, a feature length movie) 
downloading clips may not be practical due to the memory capacity and processing 

5 capabilities of current mobile devices. In such situations, multimedia clips may be 
streamed to the mobile device. It will be appreciated, of course, that any size media clip 
may be streamed. Various techniques (e.g., streaming protocols) for streaming are 
known to those working in this area. For example, the Real Time Streaming Protocol 
(RFC 2326, Intemet Engineering Task Force, Internet Draft drafi-ietf-mmusic- 

10 rfc2326bis-04) may be used. 

Such streaming of a multimedia clip typically reduces the amount of memory 
capacity, as opposed to downloading an entire clip before it is played. Such reductions 
are realized because the multimedia content is communicated to the mobile device 
continuously (as a stream) and once a portion of the stream is played by the mobile 

15 device, it may be discarded. 

However, current approaches for streaming multimedia content have certain 
drawbacks. For example, a wireless connection (over which multimedia clips are 
streamed) between the mobile device and a data network included in a communication 
system with which the mobile device is connected may be terminated for any number of 

20 reasons (e.g. loss of coverage, signal fade, communication error, etc.). If the wireless 
connection is terminated during the streaming of a clip, the streaming of that clip will 
also be terminated. 
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After the wireless connection is reestablished between the mobile device and the 
data network, using current approaches, a user of the mobile device must restart 
streaming of the interrupted clip from the beginning of the clip. For relatively short clips, 
this may not be too much of an inconvenience for a user, as replaying the clip from the 

5 beginning is not overly time consuming. However, for longer clips, restarting the clip 
from the beginning is both inconvenient and inefficient. Such an approach is time 
inefficient for the user and resource inefficient for the network resources due the need to 
re-stream the portion of the clip that was streamed prior to the termination of the wireless 
connection. Based on the foregoing, alternative approaches for streaming multimedia 

10 content are desirable. 
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SUMMARY 

According to an exemplary embodiment, a method for streaming multimedia 
content in a wireless communication system comprises receiving, in a data network, a 
request from a mobile device to stream multimedia content to the mobile device from the 

5 network. Such a request is transmitted over a wireless connection. The wireless 
connection may include a physical link, a data link and a network link. The wireless 
connection may be used to conraiunicate packet data between the data network and the 
mobile device. After receiving the request in the data network, the method includes 
streaming a portion of the requested multimedia content from the data network to the 

10 mobile device. The method fiirther includes detecting a termination of the wireless 
connection during the streaming of the multimedia content. 

Li response to detection of the termination of the wireless connection, information 
indicating a point in the multimedia content where the termination occurred is retained. 
This information may be retained in an entity included in the data network. 

15 Alternatively, depending on the particular embodiment, the information may be retained 
in the mobile device. The method fiirther includes re-establishing the wireless 
connection and then resuming streaming of the multimedia content based on the retained 
information. For example, the multimedia content may be streamed from the point where 
termination of the wireless connection occurred, as indicated by the retained information. 

20 As one alternative, the multimedia content may be streamed from a point in the content 
that is a predetermined period of time earlier than the indicated termination point. 

In another exemplary embodiment, an option of whether or not to resume 
streaming the multimedia content may be provided to a user of the mobile device. In yet 
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another exemplary embodiment, resumption of streaming of the muUimedia content may 
occur automatically once the wireless connection is reestabhshed. 

These as well as other advantages of various aspects of the present invention will 
become apparent to those of ordinary skill in the art by reading the following detailed 
5 description, with appropriate reference to the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Exemplary embodiments of the present invention are described herein with 
reference to the drawings, in which: 

Figure 1 is a block diagram illustrating an exemplary communication system in 
5 accordance with an embodiment of the invention; 

Figure 2 is a flowchart illustrating an exemplary method for streaming multimedia 
content in accordance with an embodiment of the invention, which may be implemented 
in the communication system of Figure 1; 

Figures 3A and 3B are flowcharts illustrating exemplary methods for determining 
10 a wireless connection has been terminated in accordance with embodiments of the 
invention; 

Figure 4 is a flowchart illustrating an exemplary method for retaining information 
indicating a point in a multimedia content stream where a wireless connection 
termination occurred in accordance with an embodiment of the invention; and 
15 Figure 5 is a flowchart illustrating an exemplary method for resuming streaming 

of multimedia content in accordance with an embodiment of the invention. 



MCDONNELL BOEHNEN 
HULBERT&BERGHOFF 
300 SOUTH WACKER DRIVE 
CHICAGO. ILUNOiS 60800 
TELEPHONE (312) 013-0001 



DETAILED DESCRIPTION 
Exemplary system for streamins multimedia content 

Referring to Figure 1, a block diagram of an exemplary wireless communication 
system 100 which may be used to stream multimedia content to a mobile device (such as 
5 mobile devices 105 and 110) is shown. This exemplary system diagram is provided for 
purposes of illustration and not limitation. It will be appreciated that other media 
streaming architectures are possible and are within the scope of the present invention. 

In addition to the mobile devices 105 and 110, the communication system 100 
comprises a base transceiver station (BTS) 115 for communicating with the mobile 
10 devices 105 and 110 using radio signals. The BTS 115 is coupled with a base station 
controller (BSC) 120. The BSC 120 manages the signals sent to/from the BTS 115. 
Depending on the particular embodiment, the BSC 120 may be coupled with a single 
BTS 1 15, or may be coupled with a plurality of BTSs. 

The BSC 120 is further coupled with a packet data serving node (PDSN) 125 and 
15 a mobile switching center (MSC) 130. The PDSN 125 provides data network access, and 
manages packet data sent to/from the mobile devices 105 and 110, via the BTS 115 and 
the BSC 120. The MSC 130 provides connectivity with a pubHc switched telephone 
network (PSTN) 135 and routes voice information (e.g., phone conversations) to/from the 
mobile devices 105 and 110, given such capabilities exist on those devices. 
20 The PDSN 125 is coupled with a data network 137 via a Home Agent (HA) 140 

device included in the data network 137. As is known, HA 140 is a router on the mobile 
device's home network (e.g., the data network 137) that maintains information about the 
device's current location, as identified in a "care-of address." The home network is the 
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data network with which the mobile device is associated, such as a data network of a 
service provider with which the mobile devices 105 and 1 10 are associated. The HA 140 
uses tunneling mechanisms to forward Internet traffic so that the device's Intemet 
Protocol (IP) address doesn't have to be changed each time it connects from a different 

5 location. The HA 140 typically works in conjunction with a foreign agent (e.g., the 
PDSN 125 in system 100), which is part of a visited network and includes a router for 
communicating data with the mobile device 105 and the HA 140. Thus, the HA 140 (in 
conjunction with a foreign agent in some embodiments) controls data communications 
between networks (home and visited). See TIA Interim Standard - cdma2000 Wireless 

10 IP Network Standard, TIA/IS-835-B, September 2002. 

The HA 140 is further coupled with a multimedia gateway (MMG) 145 and a next 
generation data gateway (NGG) 150, which will be discussed further below. The HA 140 
is also coupled with an authentication, authorization and accounting server/service 
creation system (AAA/SCS) 155. Such system configurations are known and provide 

15 functionality to authenticate the mobile devices 105 and 110 to provide access to their 
home network as well as managing the services (e.g., text messaging, voice mail, etc.) 
available to the mobile devices 105 and 110. The details of such system configurations 
will not be discussed further here except to the extent to aid in imderstanding the 
exemplary embodiments described herein. 

20 The NGG 150, for the system 100, allows for interoperability with a variety of 

different types of mobile devices and may be termed to be an open, standards-based 
platform for communicating data using protocols such as http. Likewise, the MMG 145 
also provides for interoperability with a variety of different mobile devices. However, 
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the MMG 145 provides functionality for providing access to multimedia content using 
media streaming protocols, such as the Real Time Streaming Protocol (RTSP), as 
described in RFC 2326. 

If a clip is requested to be downloaded to mobile device 105, an http command, 
5 for example, is sent from the mobile device 105 via the NGG 150 to an 
application/content server 160, which may also be a server farm comprising a plurality of 
content servers. The clip is then downloaded (using the http protocol) to the mobile 
device 105, where it can be viewed (after is completely downloaded) using an appropriate 
media player client. 

10 By the way of comparison, if a multimedia clip is requested to be streamed to the 

mobile device 105, an RTSP command, for example, is sent from the mobile device 105, 
via the MMG 145 to the application/content server 160. The RTSP command may be 
sent to the application/content server 160 via a multicast router 165 or, alternatively, may 
be sent directly to the application/content server 160. 

15 The clip is then streamed to the mobile device via the MMG 145 using an 

appropriate protocol, such as RTSP, and an appropriate media encoding technique, such 
as MP3, WMA or the Synchronous Multimedia Integration Language (SMIL), among 
others. This streaming may be done via the multicast router 165 or, altematively, the 
multimedia content may be sent directly from the application/content server 160 to the 

20 MMG 145 to be streamed to the mobile device 105. Techniques for streaming using 
unicast or multicast approaches are known and will not be discussed in detail here. Once 
the content is transferred to MMG 145 (e.g., via the multicast router 165 or directly) it is 
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then communicated to the mobile device 105 via the HA 140, the PDSN 125, the BSC 
125 and the BTS 115 using the streaming protocol (e.g., RTSP). 

As was noted above, using current approaches, if the wireless connection between 
the mobile device (e.g., the mobile device 105) and the data network 137 (e.g., the MMG 

5 145 of the network 137) is terminated during the streaming of a multimedia clip, a user of 
the mobile device 105 must retum to the beginning of the clip and begin streaming the 
entire clip once the wireless connection has been reestablished. This approach is time 
and resource inefficient, as was previously discussed. It also results in a negative 
customer experience if the user experiences such a termination after playing a significant 

10 portion of a long clip (e.g., fifteen minutes of a thirty minute video clip). 

Exemplary Methods for streamin2 multimedia content 

The methods illustrated in Figures 2-5 may be implemented in the system 100 

shown in Figure 1, though the invention is not so limited and other wireless communication 
15 system configurations may be employed. However, for the purposes of this disclosure, 

these methods will be described with reference to Figure 1 and in the context of the 

foregoing description of that figure. 

Referring now to Figure 2, a flowchart illustrating an exemplary method 200 for 

streaming multimedia content in a wireless communication system (such as system 100) that 
20 overcomes the foregoing discussed disadvantages of current approaches is shown. The 

method 200, at block 210, comprises establishing a wireless connection between a mobile 

device (e.g. the mobile device 105) and a data network (e.g. the data network 137, which is 

the home network of the mobile device 105 for this embodiment). The connection with the 
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data network 137 is authenticated/authorized by the AAA/SCS 155, as is known. At block 
220, a request that multimedia content be streamed to the mobile device 105 is sent from the 
mobile device 105 to the application/content server 160. This request may be sent using a 
command of any appropriate streaming protocol, such as RTSP. 

5 As may be seen in Figure 1, for the system 100, such a request is communicated 

from the mobile device 105 to the application/content server 160 via the BTS 115, the BSC 
120, the PDSN 125, the HA 140, the MMG 145 and then either directly to the 
application/content server 160, or to content server 160 the via the multicast router 165. It 
will be appreciated that a plurality of content servers and multicast routers may be employed 

10 in the system 100, and the configuration shown is exemplary. 

The request is then received at the content server 160 at block 230. Responsive to 
receiving the request, the content server 160 streams the requested multimedia content to the 
mobile device at block 240. The requested multimedia content ("clip") may be streamed 
(e.g., using RTSP) in a unicast fashion, from the application content server 160 directly to 

15 the MMG 145 and then to the mobile device 105 via the HA 140, the PDSN 125, the BSC 
120 and the BTS 115. Alternatively, the multimedia clip may be streamed to multiple 
devices simultaneously using the multicast router 165 to communicate the multimedia clip 
to the MMG 145 (and other devices), or may be streamed to a plurality of mobile devices on 
various data networks using a plurality of multicast routers. Such techniques are known, 

20 and will not be described in fiirther detail. 

At block 250, termination of the wireless connection is detected. Such detection 
may be accomplished in a nimiber of fashions, and the invention is not limited to the use of 
any particular technique for detecting such termination. Exemplary embodiments for 
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detecting termination of a wireless connection are discussed in further detail with respect to 
Figures 3A and 3B. Briefly, however, a termination may occur due to a loss of coverage, 
signal fade, a communication error, or any number of other causes, such as, for example, 
an inadvertent hang up (or disconnect) by a user of the mobile device. 

5 At block 260, information is retained that indicates a point in the stream of the 

multimedia clip where termination of the wireless connection occurred. This information 
may be retained in the MMG 145, the content server 160, in the mobile device 105 itself, 
or in any other appropriate entity in the communication system 100. As was indicated 
above, current approaches for streaming multimedia content do not provide for retaining 

10 such information. An exemplary embodiment for retaining such information is discussed 
in further detail with respect to Figure 4. Of course, nimierous other techniques may also 
be employed to gather and retain such information. For example, a timer may be used in 
the mobile device 105. If a termination of the wireless connection is detected by the 
mobile device, the value of the timer may be stored, such as using appropriate logic 

15 executed on the mobile device, at the time when the termination is detected. This timer 
value would then correspond to the point in the multimedia stream where the termination 
occurred. 

Alternatively, the MMG 145 could be notified of the termination, such as by a 
notification service application running on the PDSN 125. In response to a notification 
20 that the wireless connection has been terminated, the MMG 145 may execute appropriate 
logic to retain information related to the point in the multimedia content stream where the 
termination occurred. Depending on the particular embodiment, the retained information 
may be included in an extensible markup language (XML) attribute tag and comprise a 
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timestamp corresponding to the point in the multimedia content stream where the 
termination occurred. Such an approach may be readily employed for embodiments 
where the multimedia content is encoded with the Synchronous Multimedia Integration 
Language (SMIL). Of course, other encoding methods may be employed that utilize 

5 XML attribute tags to retain such information. For example, depending the media type, 
the retained information may be included in special purpose RTSP headers (such as for 
MPS or WMA formatted multimedia content). 

In addition to a timestamp, or some other indication of the point in the multimedia 
stream where the termination occurred, the retained information includes an identifier of 

10 the mobile device 105 that experienced termination of its wireless connection during 
streaming. Such an identifier may be a point-to-point protocol (???) link identifier, a 
network address identifier (NAI) or an IP address. Such identifications are known, and 
are not described in detail here. Of course, other techniques besides ??? link identifiers, 
NAIs and IP addresses are possible, and the invention is not limited to these particular 

15 approaches. 

At block 270, the method 200 further comprises reestabhshing the wireless 
connection between the mobile device 105 and the data network 137. Once the wireless 
connection is reestablished, streaming of the multimedia content may be resumed based 
on the retained information. Depending on the particular embodiment, the retained 
20 information may be contained in the mobile device 105, the MMG 145, the application 
server 160, or another entity in the communication system 100. 

Once the wireless connection is reestablished, the retained information (if not 
already contained on the MMG 145 and/or the content server 160) may be communicated 
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to the MMG 145 and/or the content server 160. The MMG 145 and/or the content server 
may then execute appropriate logic to resume streaming the multimedia content based on 
the retained information. This resumption may occur automatically, or may occur as a 
result of a user selection to resume streaming the content. It will be appreciated that the 

5 wireless coimection may be reestablished via a different MMG (e.g., second MMG) than 
the original wireless connection. In this situation, the retained information would be 
communicated to the MMG with which the wireless connection is reestablished and 
streaming would be resumed based on the retained information with second MMG. 

In one embodiment, the multimedia content may be streamed from the point in the 

10 stream where the retained information indicates the termination occurred. Alternatively, 
the multimedia content may be streamed from a point that is a predetermined amount of 
time earlier in the stream than the point where the retained information indicates the 
termination occurred (e.g., 15 seconds earlier), so as to provide some overlap in the 
streamed content. 

15 

Exemplary Methods for Detecting Wireless Connection Termination 

Referring now to Figure 3A, a flowchart illustrating an exemplary method 300 for 
detecting the termination of a wireless connection is shown. At block 310, the BSC 120 
(as shown in Figure 1) determines that termination of the wireless connection has 
20 occurred by determining that a number of bad (communication) frames have been 
received from the mobile device 105. The number of bad frames may be determined in 
any number of ways, and such techniques are known. For the method 300, when the 
number of bad frames received consecutively by the BSC 120 exceeds a threshold value, 
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the BSC 120 determines that termination of the wireless connection has occurred (e.g., 
due to signal fade, communication error, inadvertent hang up, etc.). 

At block 320, the BSC 120 then communicates a message to the MMG 145 and/or 
the content server 160 that termination of the wireless connection has occurred. In 

5 response to this message, information about the multimedia content stream is retained, as 
was described above with reference to Figure 2, by executing appropriate logic on the 
MMG 145 and/or the content server 160. 

Referring now to Figure 3B, a flowchart showing an altemative method 350 for 
determining that termination of a wireless connection has occurred is shown. At block 

10 360, the BSC 120 determines that the wireless connection cannot be handed off from one 
BTS (e.g. 115) to another BTS (not shown). Such handoffs occur when the mobile 
device 105 is moved from the coverage area of one BTS into the coverage area of another 
BTS. Such terminations may occur, for example, if the second BTS is overloaded with 
other wireless connections (e.g., is at its connection capacity or bandwidth capability) or 

15 if there is insufficient overlap in the coverage of the two BTSs. As a result of either of 
these situations, the BSC 120 will terminate the wireless connection. Of course, 
detecting that termination the wireless connection has occurred may be done in a number 
of other ways. 

At block 370, the BSC 120 then communicates a message to the MMG 145 and/or 
20 the content server 160 that termination of the wireless connection has occurred. As was 
described above with reference to Fig. 3A, in response to this message, information about 
the multimedia content stream is retained, as was described above with reference to 
Figure 2, by executing appropriate logic on the MMG 145 and/or the content server 160. 
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Exemplary Method for Retaining Streamins Information 

Referring now to Figure 4, a flowchart illustrating an exemplary method 400 for 
retaining information related to a multimedia content stream that is interrupted by the 
5 termination of a wireless connection is shown. At block 410, the information to be 
retained is collected by the content server 160. As was previously discussed, the content 
server 160 may collect such information in response to receiving a message from, for 
example, the BSC 120, that the wireless coimection has been terminated. As was also 
described above, the information to be retained includes an indication of the point in the 
10 multimedia stream where the termination occurred (e.g. such as a timestamp, a frame 
reference, an elapsed time, etc.) and an identifier of the mobile device which experienced 
the termination. 

At block 420, the information to be retained is communicated to the MMG 145 
and is stored in a database that is either included in the MMG 145 or in a database that is 

15 operatively associated with the MMG 145. Such an approach is advantageous as the 
MMG 145 exists in the data network 137 (e.g., the home network of the mobile device 
105). In this regard, when the wireless coimection is reestablished between the mobile 
device 105 and the data network 137, the MMG 145 may be readily notified of this 
occurrence and, in turn, provide a notification to the content server 160 that the wireless 

20 connection has been reestablished so that resumption of the multimedia content stream 
may be effected, such as by using the approaches discussed herein. 
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Exemplary Method for Resumine Streamin2 

Referring now to Figure 5, a flowchart illustrating an exemplary method 500 for 
resuming streaming of a multimedia content stream is shown. At block 510 of the 
method 500, a user option is provided (e.g., such as using a dialog box on the mobile 
5 device 105) to either resume streaming of an interrupted multimedia stream or to cancel 
the stream. This option is provided in response to the wireless connection be 
reestablished. At block 520, in response to the user indicating that streaming should be 
continued, the retained information is communicated from the MMG 145 (e.g., from the 
database as described with reference to Figure 4) to the content server 160. 
10 At block 530, the content server 160 then communicates appropriate logic to the 

MMG 145 (or a second MMG) for resuming the multimedia content stream in 
accordance with the retained information. The logic is then executed by the MMG 145 
(e.g., in conjunction with the content server 160), at block 540, to resume streaming of 
the multimedia content, such as in the manners described above. 

15 

Conclusion 

Exemplary arrangements of the present invention have been described herein. It 
will be appreciated, however, that those skilled in the art will understand that changes and 
modifications may be made to these arrangements without departing from the true scope 
20 and spirit of the present invention, which is defined by the following claims. 
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